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FIELD 

This patent specification relates to fiill-field imaging of the breast. More 
particularly, this patent specification relates to systems, computer program products, and 
related methods for presenting, manipulating, annotating, and/or archiving full-field 
20 breast image information such as fiill-field breast ultrasound information. 

BACKGROUND 

The ongoing disconnect between the possible and the practical is especially 
visible in the medical sciences field where, at one end, sophisticated research and 
25 development efforts continue to advance the firontiers of disease prevention and lifespan 
extension while, at the other end, governments and insurers continue to struggle with 
providing a reasonable standard of care at a manageable cost to an aging population. The 
-medical imaging field offers an example of this disconnect. Sophisticated imaging 
v.devices and associated computer algorithms have been developed that can produce 
30 gigabytes of high-quality images of a patient's interior anatomy. However, cost- 
pressured hospitals and time-pressured clinicians are justifiably resistant to adopting a 
standard of care for disease screening that would add yet another modality to clinical 
workflow and hold clinicians accountable for large amounts of additional image data per 



patient. In the practical world of medical imaging, it is possible for a proposed screening 
modality to fail simply because it provides "too much information" to the clinician. 

Breast cancer is the most common cancer among women other than skin cancer, 
and is the second leading cause of cancer death in women after lung cancer. For the year 
5 2003, the American Cancer Society estimates about 21 1,300 new invasive cases of breast 
cancer and 39,800 deaths from breast cancer among women in the United States. X-ray 
mammography is currently the only imaging method for mass breast cancer screening. In 
health maintenance organizations (HMOs) and other medical organizations, specialized 
x-ray mammography clinics designed for high patient throughput are being increasingly 
10 used to screen as many women as possible in a time and cost efficient manner. 

Numerous studies have shown that early detection saves lives and increases treatment 
options. 

As discussed in Ser. No. 10/160,836, supra, it has been found that the use of 
ultrasound mammography (sonomammography) in conjunction with conventional x-ray 

15 mammography can drastically increase the early breast cancer detection rate. Whereas x- 
ray mammograms only detect a summation of the x-ray opacity of individual slices over 
the entire breast, ultrasound can separately detect the sonographic properties of individual 
slices of breast tissue, and therefore may assist the radiologist in detecting breast lesions 
where x-ray mammography alone fails. 

20 Although primarily described infra in the context of ultrasound imaging, it is to be 

appreciated that data from other fiill-field breast imaging modalities (e.g., MRI, CT, PET) 
can be advantageously processed and/or archived according to one or more of the 
preferred embodiments described herein. As used herein, the term "radiologist" 
generically refers to a medical professional, clinician, or similar person that analyzes 

25 medical images and makes clinical determinations therefrom, it being understood that 
such person might be titled differently, or might have varying qualifications, depending 
on the country or locality of their particular medical environment, or depending on the 
particular imaging modality being used. 

One of the problems involved in integrating a full-field modality such as 

30 ultrasound into existing breast cancer screening environments relates generally to clinical 
workflow. Generally speaking, it is neither time-efficient nor cost-efficient to perform an 




adjunctive full-field breast ultrasound (FFBU) scan on every patient. However, it is 
likewise not efficient to perform FFBU screening on an ad hoc basis, for example, in 
which patients would get called back to the screening clinic for an FFBU only when the 
radiologist or other clinician analyzing their x-ray manmiogram determines that an FFBU 
5 procedure is required. It would be desirable to provide a method and related systems for 
streamlining the x-ray mammography/FFBU patient visit workflow so as to jointly use 
the x-ray mammography equipment, the FFBU equipment, and the associated clinical 
staff time in an efficient manner. 

Another problem involved in integrating a fiill-field breast imaging modality into 

10 existing breast cancer screening environments relates generally to archiving the full-field 
image data, such as fiill-field breast ultrasound data, in addition to the x-ray mammogram 
data. A most complete archive would comprise an entire three-dimensional volume of 
ultrasound data. However, this three-dimensional ultrasound dataset is generally much 
more voluminous than the traditional x-ray mammogram data, e.g., on the order of 

15 gigabytes for the complete ultrasound volume as compared to tens of megabytes for 
complete x-ray mammogram data. Regardless of whether the information would be 
stored in a totally digital archive, a hybrid digital/hardcopy archive, or a purely hardcopy 
archive, storage space would become a problem. Additionally, other problems can arise 
relating to the storage of the entire ultrasound data volume, such as the possibility for 

20 subsequent malpractice claims involving unfair hindsight analyses of the entire 
ultrasoxmd data volume. 

In view of the above discussions, it would be desirable to provide methods and 
associated systems for obtaining, processing, and/or and archiving full-field breast image 
data, such as full-field breast ultrasound (FFBU) data, in a manner that promotes ready 

25 integration with current x-ray mammogram-based breast cancer screening methodologies. 
It would be desirable to provide such methods and associated systems for full- 
field breast imaging that avoids or reduces clinician data overload problems that can arise 
from the existence of large aimounts of three-dimensional full-field breast image data. 

It would be still further desirable to provide such methods and associated systems 

30 that reduce required archive space for full-field breast image data while still providing 
sufficient data for future analysis or comparison purposes. 




SUMMARY 

A system, computer program product, and related methods are provided for 
processing a three-dimensional data volume representing at least one physical property of 
5 a breast obtained during a breast imaging session, wherein two-dimensional thick-slice 
images computed from the three-dimensional data volume are used to facilitate efficient 
archiving of the at least one physical property for that breast imaging session, the two- 
dimensional thick-slice images corresponding to slab-like subvolumes of the breast. 
According to a preferred embodiment, the two-dimensional thick-slice images are 

10 archived such that archiving of the entire three-dimensional data volume is not required, 
thereby preserving data storage space and associated resources while still providing an 
archival dataset sufficient for future reference purposes. Although described herein in the 
context of full-field breast ultrasound (FFBU) imaging, it is to be appreciated that the 
features and advantages of the preferred embodiments are applicable for a variety of 

15 other full-field breast imaging modalities such as MRI, CT, PET, etc. 

According to one preferred embodiment, the slab-like subvolumes associated with 
the thick-slice images have an average thickness corresponding to a lesion size to be 
detected according to the FFBU imaging modality. Preferably, the slab-like subvolumes 
collectively occupy substantially all of a clinically relevant portion of the breast volume, 

20 and the archival dataset comprises each of the thick-slice images, but does not include the 
original three-dimensional data volume. Storage space is preserved because the 
collection of thick-slice images is a smaller set of data than the original three-dimensional 
data volume, and archival utility is maintained because the slab thickness is small enough 
to capture the lesion size to be detected. 

25 Preferably, the thick-slice images maintained in the archival dataset are the same 

thick-slice images that are viewed by a viewer, such as a radiologist, during a viewing 
session. User interface tools are provided to allow the viewer to annotate the thick-slice 
images, view planar and/or "raw" ultrasound slices corresponding to selected locations on 
the thick-slice images, conveniently zoom to regions of interest, and allow other 

30 convenient and useful analysis activities. Optionally, planar ultrasound slices 

corresponding to selected locations of interest may be included in the thick-slice archival 



dataset. In one preferred embodiment, the radiologist may select a particular point on a 
thick-slice image, such as the center of a possible density, to instantiate a real-time 
segmentation and volume computation, the display unit thereafter highlighting the 
segmented lesion on the display and presenting the volume result to the viewer. In 
5 another preferred embodiment, the radiologist may view and provide annotations related 
to markers automatically generated by a computer-aided diagnosis (CAD) system that has 
processed the three-dimensional data volume, the thick-slice images, and/or the 
associated x-ray mammogram data. Annotations, marks, and any of a variety of other 
viewer inputs are then archived in a manner that associates them with the thick-slice 

10 image archival dataset. 

According to another preferred embodiment, a system, computer program 
product, and related methods are provided for facilitating workflow in an x-ray 
mammography screening environment such that integration of an adjunctive full-field 
breast imaging modality, such as FFBU, can be achieved with reduced marginal cost and, 

15 in some cases, can even lower overall screening costs. Prior to a patient's visit to an x- 
ray mammogram clinic, previously recorded medically-relevant information for that 
patient is accessed for determining whether that patient should be scheduled for x-ray 
mammogram alone versus the combination of x-ray mammogram and FFBU scan. If the 
combination x-ray mammogram and FFBU scan is indicated, a scheduler generates an 

20 appointment and allocates clinic resources such that the x-ray mammogram and the 
FFBU scan take place on the same patient visit. The previously recorded medically- 
relevant information may include archived x-ray image data, archived FFBU image data, 
patient history, family history, and social/demographic information. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a conceptual view of a breast cancer screening system according 
to a preferred embodiment; 

FIG. 2 illustrates a conceptual view of a breast cancer screening system according 
to a preferred embodiment; 
30 FIG. 3 illustrates a conceptual workflow in a breast cancer screening environment 

according to a preferred embodiment; 
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FIG. 4 illustrates workflow steps in an adjunctive full-field breast imaging 
environment according to a preferred embodiment; 

FIG. 5 illustrates a method for viewing and processing breast image data 
according to a preferred embodiment; 
5 FIGS. 6-9 each illustrate a full-field breast ultrasound (FFBU) archival dataset 

according to a preferred embodiment; and 

FIG. 10 illustrates a display of an FFBU viewing workstation according to a 
preferred embodiment. 




10 DETAILED DESCRIPTION 

FIG. 1 illustrates a conceptual view of a breast cancer screening system according 
to a preferred embodiment comprising a full-field breast ultrasound (FFBU) scanner 102, 
a viewing workstation 104, and an archive 106. In one preferred embodiment, the breast 
cancer screening system of FIG. 1 is adjunctive to an x-ray mammography system, 

15 although in an alternative preferred embodiment, FFBU imaging is used as a sole basis 
for breast cancer screening. _ While the latter preferred embodiment affords an advantage 
that there are no x-ray radiation dangers, it is to be appreciated that using ultrasound as a 
sole breast cancer screening modality is not yet approved by the FDA in the United States 
or other known governmental authority. Nevertheless, another appealing feature of the 

20 latter preferred embodiment is that, because FFBU scanning can usually involve less 
extreme breast compression than x-ray mammography, e.g. , 8 pounds as compared to 20 
pounds or more, it affords a further potential advantage that more women might be 
willing to get screened more often because there is less pain involved in the procedure. 
The FFBU scanner 102 is similar to that described in PCT/US03/31434 filed 

25 October 1, 2003, which is incorporated by reference herein, and performs full-field 
imaging of the breast to obtain a three-dimensional data volume corresponding to 
sonographic properties of the breast tissue. The patient's breast is placed in a 
compression and scanning assembly 108 that, in conjunction with an FFBU processor 
1 10, scans the breast such that a three-dimensional data volume is generated. Preferably, 

30 the breast is compressed along a standard x-ray meunmograrii plane such as the 
craniocaudal (CC) or mediolateral oblique (MLO) plane, or other plane used in the 




associated x-ray mammograms preferably being taken on the same office visit. However, 
the scope of the preferred embodiments is not so limited to these x-ray compression 
planes. 

The FFBU processor 1 10 and/or another computer coupled to receive data 
5 therefrom then processes the three-dimensional data volume to generate a plurality of 
two-dimensional thick-slice images corresponding to slab-like subvolumes of the breast. 
Preferably, each of the slab-like subvolumes is parallel to a standard x-ray meimmogram 
plane, although the scope of the preferred embodiments is not so limited. For clarity of 
description herein, the y-axis represents the head-to-toe direction with respect to the 

10 patient, the x-axis represents the left-to-right direction, and the z-axis extends outward 
from the chest wall. The x-y, y-z, and x-z planes thus correspond to the coronal, sagittal, 
and axial planes, respectively. Thus, by way of example, thick-slice images 
corresponding to a CC view, for which the breast was scanned while compressed along 
an x-z (axial) plane, would correspond to slab-like subvolumes substantially parallel to 

15 the x-z (axial plane), the slab-like volumes extending vertically in the "y" direction by an 
amount that can be referred to as their slab thickness or thick-slice thickness. Preferably, 
the thick-slice images are computed according to one or more of the methods described in 
one or more of the above incorporated applications, and/or the commonly assigned U.S. 
Ser. No. 60/439,437, filed January 9, 2003, and/or the commonly assigned U.S. Ser. No. 

20 10/305,661, filed November 27, 2002, each of which is incorporated by reference herein. 

Preferably, the collection of slab-like volumes, each having a corresponding two- 
dimensional thick-slice image, collectively occupy substantially all of a clinically 
relevant portion of the breast volume. In such arrangement, displaying all of the thick- 
slice images to the viewer can allow for a fast appreciation of structures in the breast, or 

25 lack thereof, while at the same time not requiring the viewer to slog through each slice 
used to generate the three-dimensional data volume. The clinically relevant portion of 
the breast volume refers to the portion of the breast volume imaged by the full-field 
imaging system that is generally recognized to be locations where breast cancer can 
occur. Thus, for example, areas very close to the skinline might be considered as not 

30 clinically relevant. As another example, the interior portions of silicone breast implants 
may also be considered as not clinically relevant because there is no living tissue present. 




The viewing workstation 104, which is similar to that described in Ser. No. 
10/305-936, supra, provides an interactive display and associated user interface for 
viewing, analyzing, and annotating FFBU data in conjunction with x-ray mammography 
data. In an FFBU-only environment, the portions dedicated to displaying x-ray 
5 mammogram data can be omitted or replaced by further display devices allowing further 
simultaneous views of the FFBU data. Viewing workstation 104 comprises an x-ray 
mammogram display 1 12 for allowing display of x-ray mammograms 1 14. Although 
shown as a film-based unit in FIG. 1, the x-ray mammogram display 1 12 can 
alternatively comprise an all-digital workstation in a digital mammography environment. 

10 The viewing workstation 104 can be conformed to various standards for picture archiving 
and retrieval (PACS) such as those described in the DICOM standard (Digital Imaging 
and Communications in Medicine) defined and maintained by the National Electrical 
Manufacturers Association. 

Viewing workstation 104 further comprises a full-sized LCD display 116 and two 

15 CRT displays 118 for viewing the FFBU thick-slice data in conjunction, if necessary, 
with planar ultrasound slices derived from the FFBU scans. As described in Ser. No. 
1 0/305,936, supra^ although many different display arrangements may be used, one 
preferred method is to use CRT displays to display planar ultrasound data and the LCD 
displays to display the thick-slice images. Computer-aided diagnosis (CAD) markers 

20 may be provided in conjunction with the FFBU thick-slice data and/or the x-ray 
mammogram data. 

Viewing workstation 104 further comprises a user interface processor 120 for 
receiving viewer inputs and driving the displays 116-118. Any of a variety of user 
interface devices (not shown) can be provided in accordance with the preferred 

25 embodiments, ranging anywhere from simple a keyboard/mouse arrangement, to foot- 
pedal and touch-screen display arrangements, all the way to highly exotic user interface 
methods based on voice-actuated inputs, retinal tracking inputs, heads-up displays, 
lenticular displays, virtual reality displays, holographic displays, stereotactic displays, 
forced-mechanical-feedback displays, and audible-annotation displays. 

30 Viewing workstation 104 further comprises an archiving processor 122 in 

communication with the FFBU scanner 102 and/or the user interface processor 120 




configured and adapted for achieving the archiving ftinctionahties described herein. 
Although the particular hardware arrangement of FIG. 1 represents one preferred system, 
it is to be appreciated that the functionalities of the FFBU processor 1 10, user interface 
processor 120, and archive processor 122 can be allocated, separated, integrated, and/or 
5 tiered in a variety of different ways that achieve the functionalities described herein 
without departing from the scope of the preferred embodiments. By way of example, a 
single stand-alone processor separate from the FFBU scanner 102 and viewing station 
104 (connected to them across a LAN, MAN, or WAN network, for example) can be 
substituted for the separate hardware elements 110, 120, and 122. By way of fiirther 

10 example, the display processor 120 can be programmed to perform thick-slice generation, 
user interface functions, CAD functions, and archiving functions by itself, and so on. 

Archive 106 is coupled generally to viewing workstation 104, and particularly to 
archive processor 122, for receiving and storing an archival dataset for long-term storage 
purposes or for other future reference. It is to be appreciated that the archive 106, 

15 although shown iconically as a computer hard disk, can comprise any tangible storage 
medium capable of storing two-dimensional image data. Examples include paper, film, 
magnetic disk, optical disk, magnetic tape, and non-volatile integrated circuit memory. 
Thus, for example, the archive processor 122 can be coupled to a DICOM-compliant 
printer, for example, which prints the archival dataset onto paper or film, and then the 

20 paper or film is carried over to a physical drawer or stack for long-term storage. 

One special advantage according to a preferred embodiment is backward- 
compatibility way with today's existing two-dimensionally-based infrastructure, because 
the preferred FFBU archive datasets are two-dimensional in nature, intended to be shovm 
in a two-dimensional manner, and generally not intended for three-dimensional 

25 reconstruction. Thus, for example, in a film-based x-ray mammogram environment in 
which the films are stored in physical drawers and stacks, the two-dimensional FFBU 
archive data can be easily transferred to one or two sheets of film or paper and slipped 
into the same file as the x-ray mammogram film. In other preferred embodiments there 
may be more than two sheets of film or paper, e.g., 3-10 sheets, but generally there will 

30 not be so many sheets as to be cumbersome. This is to be contrasted with the mass 



-9- 




archiving of the entire three-dimensional data volume which, if printed out to paper or 
film, would require hundreds of sheets or more. 

It is to be appreciated, however, that the archive 106 is not limited to storing 
single flat-file records containing printouts or digital/digitized versions of the drawings 
5 described infra. For example, the preferred embodiments are readily implemented in a 
totally paperless and filmless environment as well, and in such cases the archive 106 will 
usually comprise a distributed database architecture consistent with most modem PACS 
systems. The various distributed elements composing the archive 106 can segregate, 
aggregate, index, and allocate the archival datasets described herein without departing 

10 from the scope of the preferred embodiments. For example, the different components 
(text comments, 2-D images, and annotations) can all be digitally stored in different 
places, and even on different machines or networks, and then associated with hyperlinks. 
In one preferred embodiment, the archive 106 is implemented in a DICOM-compliant 
data communications and storage architecture. 

15 As indicated by the arrows in FIG. 1, the FFBU scanner 102 forwards the FFBU 

data to the viewing workstation 104 and, upon review, assessment, annotation, and the 
creation of an archival dataset, the archival dateiset is transferred to the archive 106. 
During a subsequent screening process - for example, during next year's review process 
for the patient - the archival dataset can be retrieved from the archive 106 for 

20 comparison, if necessary, to the new FFBU and/or x-ray data. This is useful, for 

example, for ensuring that a fibroadenoma identified in year "N" does not get any larger 
in year "N+1." 

It is to be appreciated that some data collected from outside the viewing station 
1 04 can be included in the archival dataset without departing from the scope of the 
25 preferred embodiments. By way of example, radiologists often prefer speaking into a 
voice recorder and making an audio tape of their comments and assessments, which are 
later dictated into ASCII text. This text data can be readily included into the archival 
dataset without departing from the scope of the preferred embodiments. 

FIG. 2 illustrates a conceptual view of a breast cancer screening system according 
30 to a preferred embodiment in which FFBU data is used in conjunction with x-ray 

mammogram screening. In this preferred embodiment, x-ray mammogram data derived 
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from an x-ray mammogram unit 202 and adjunctive FFBU derived from FFBU scanner 
1 02 are provided to a CAD processor 204 that automatically identifies anatomical 
abnormalities in the breast tissue. Annotation road maps and/or other abnormality 
identifying information is provided to the viewing workstation 104. An archival dataset 
5 comprising the x-ray mammogram data, the FFBU thick-slice data, the CAD annotations, 
and the viewer annotations is transferred to an overall archive 206 including an archive 
106 for storing the FFBU thick-slice data and annotations related thereto, and an archive 
208 for storing the x-ray manraiogram data and annotations related thereto. As indicated 
by the arrows in FIG. 2, both the CAD processor 204 and the viewer can advantageously 

10 use the archived data for abnormality detection and assessment purposes. 

According to one preferred embodiment, viewing workstation 1 04 including 
archive processor 122 is configured to prevent the viewer from removing any 
automatically-obtained CAD markers from the FFBU dataset or the x-ray mammogram 
dataset. For quality control purposes, this will urge the viewer to enter comments for 

15 every automatically-obtained CAD marker, even clearly-false positives, instead of simply 
erasing or deleting that marker. For example, this is expected to be useful because the 
FFBU data, including the thick-slice images, can help the viewer rapidly identify 
obviously-false positives in the x-ray CAD system outputs. Since these markers are 
clearly without merit it would be tempting to simply erase or delete them. However, for 

20 overall quality-control purposes and for other practical reasons, may be better that all 
CAD markers, even the obviously false positives, are retained. 

FIG. 3 illustrates a conceptual view of a workflow system in a breast cancer 
screening environment according to a preferred embodiment. A schedule processor 302 
and a medical information database 304 are used in conjunction with the system of FIG. 2 

25 (reproduced without the CAD processor for space purposes in FIG. 3) for reducing 
marginal cost that may be incurred in an x-ray mammogram screening clinic when 
augmented with FFBU capability and, in some cases, even lowering overall screening 
costs. 

It has been found that FFBU screening according to the present and commonly 
30 assigned incorporated applications is highly amenable to standardization and the 

development of predetermined FFBU qualifying requirements and reimbursement criteria 
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by governments, insurers, HMOs, and the like. According to a preferred embodiment, 
the medical information database 304 is populated with predetermined FFBU quaiifying 
criteria as well as corresponding, previously-obtained medical information for a patient. 
A patient not meeting the predetermined FFBU qualifying criteria, as determined by 
5 schedule processor 302, is not scheduled for an FFBU scan as part of a scheduled x-ray 
mammogram visit, whereas a patient meeting the FFBU qualifying criteria is scheduled 
for an FFBU scan on the same clinic visit at which their screening x-ray mammogram is 
taken, with equipment and personnel schedules being set accordingly. The dotted arrows 
in FIG. 3 are presented to illustrate that not every patient gets scheduled for an FFBU 

10 scan. Preferably, the schedule processor 302 and medical information database 304 
comprise portions of a larger hospital information system or radiology information 
system (HIS/RIS) that automatically perform comparison of the patient data to the 
predetermined FFBU qualifying criteria. However, in other preferred embodiments the 
comparison and/or the scheduling can be manual. According to another preferred 

15 embodiment, if the patient data meets a predetermined set of higher criteria, termed 
interest-heightening criteria, the patient is scheduled for a more extensive FFBU scan 
involving additional compression planes during that same FFBU scanning session. 

Because high breast density makes x-ray mammogram screening less effective as 
a sole modality, the predetermined FFBU qualifying criteria should at least include a 

20 previously determined breast density metric for each patient, wherein women having 
"dense" or "extremely dense" breasts are automatically scheduled for an FFBU scan. 
Age, patient history data, and a variety of other information may be included such as 
family medical history, geographic location, demographic information, social 
information, financial information, and any other factor found to be related to x-ray 

25 mammography efficacy, an increase likelihood of breast cancer, and/or the ability for the 
healthcare institution to get paid and/or reimbursed for the additional procedure. 

For clarity of presentation, and by way of a simplified and non-limiting example, 
the predetermined criteria may be implemented as follows. Any woman having "dense" 
or "extremely dense" breasts automatically meets the FFBU qualifying criteria. Any 

30 woman living in Marin County, California (statistically known to have an abnormally 
high breast cancer rate), automatically meets the FFBU qualifying criteria, regardless of 
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breast density. Any woman having a prior lumpectomy meets not only the FFBU 
qualifying criteria but also the interest-heightening criteria and therefore receives a more 
extensive FFBU scanning session along additional FFBU compression planes. In private 
clinic settings, any woman having a high financial credit rating and who is a cash-paying 
5 customer, not dependent on Medicare or group health insurance, automatically meets the 
FFBU qualifying criteria, and so on. 

FIG. 4 illustrates workflow steps in an adjunctive full-field breast imaging 
environment according to a preferred embodiment, comprising a step 402 for retrieving 
previously recorded medical information for a patient and a step 404 for comparing that 

10 information to predetermined FFBU qualifying and interest-heightening criteria. At step 
406 the patient arrives at the screening clinic. At step 408, x-ray mammograms are taken, 
usually according to the standard process of obtaining CC and MLO views for each 
breast. If the FFBU qualifying criteria are not met (step 410) then the patient is simply 
released (step 418), but if they are met, then during that same clinic visit FFBU scans are 

15 taken of each breast along a first compression plane, preferably a standard x-ray 

mammogram view plane such as the CC view. If the interest-heightening qualifying 
criteria are not met (step 414) then the patient is released after the first-compression- 
plane FFBU scans are obtained (step 418), but if they are met, then the patient is not 
released until additional FFBU scans are taken of each breast along a second compression 

20 plane (step 416), preferably a second standard x-ray mammogram view plane such as the 
MLO view. 

In some cases, it might be deemed necessary to perform an FFBU procedure only 
after x-ray mammograms have been viewed, in which case the savings of pre-scheduling 
combined resources are not incurred. However, on the whole, it is expected that a 

25 workflow process according to one or more of the above preferred embodiments will 
reduce overall costs as compared an ad hoc FFBU scheduling process. 

FIG. 5 illustrates a method for viewing and processing breast image data 
according to a preferred embodiment, presented by way of example and not by limitation. 
At step 502, x-ray mammogram images are analyzed and assessed independently of data 

30 from any other modality, to the extent possible in a sole x-ray mammography 

environment. This can include viewing x-ray CAD annotations. If at step 504 FFBU 
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scans were taken for this patient, then at step 506 the FFBU data including thick-slice 
image data is analyzed in conjunction with the x-ray mammogram data, and the 
assessment is modified as necessary. This can include viewing x-ray CAD annotations, 
thick-slice image CAD annotations, planar image CAD annotations, volumetric CAD 
5 annotations projected onto the thick-slice and/or planar images, and/or joint CAD 
annotations generated from joint processing of the x-ray and FFBU data projected onto 
the thick-slice, planar images, and/or x-ray images. 

As is well-known in the art, the American College of Radiology has established a 
breast image assessment standard known as BI-RADS® (Breast Imaging Reporting and 

10 Data System) having five assessment categories: Category 1 - "negative"; Category 2 - 
"benign finding"; Category 3 - "probably benign finding - short interval follow-up 
suggested"; Category 4 - "suspicious abnormality-biopsy should be considered"; and 
Category 5 - "highly suggestive of malignancy - appropriate action should be taken". A 
sixth category termed Category 0 means that the assessment is incomplete (for any of a 

15 variety of reasons) and that further data is needed. Advantageously, at step 506 a 

suspicious lesion might be discovered even where the x-ray mammogram was evaluated 
to show no issues at all, for example, what was an ACR BI-RADS Category 1 assessment 
for x-ray alone could be drastically changed to a Category 4 after the FFBU data is 
reviewed. 

20 If no FFBU data was acquired, then at step 512 it is determined whether there is a 

particular amount of suspiciousness falling short of a definite malignancy finding, and 
perhaps something that would warrant a biopsy procedure or other partially invasive test. 
This is termed "suspicious abnormality" in the example of FIG. 5, but the scope of the 
preferred embodiments is not so limited. If present, then an FFBU scan is obtained at 

25 step 514. Although this usually involves a patient call-back, it could end up obviating the 
need for a biopsy procedure or other partially invasive test. Another reason to have an 
FFBU performed is shown at step 516, if there is a Category 0 assessment that can arise, 
for example, if the breast was so dense that the x-ray mammogram could really 
communicate no information at all, or if there was some other problem obtaining an 

30 acceptable x-ray mammogram image. However, if it is determined at steps 512 and 516 
that there were no problems with the x-ray mammogram image or its contents, then at 
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step 510 the x-ray mammograni data is archived and the breast cancer screening process 
is complete for that particular visit/session/year. 

In one preferred embodiment, the original three-dimensional data volumes, which 
are not included in the archived dataset, are actively deleted using an affirmative deletion 
5 process. In another preferred embodiment, the original three-dimensional data volumes 
are passively deleted, that is, they are permitted to be maintained on the hard drive(s) 
associated with the user interface processor 120, where they were last used, until such 
time as there is no more space to keep them there. Thus, for example, the hard drive 
associated with the user interface processor 120 may have 1TB of net storage capacity 

10 available as a local cache for maintaining the three-dimensional data volumes for the 
radiologist viewing sessions. If three-dimensional data volumes have a size of 4GB for 
each case, then up to 250 cases can be temporarily stored in the 1TB cache. After 
initially filling up 250 cases of data, the cache subsequently overwrites the oldest cases 
with newly-received cases as they arrive. This arrangement is sometimes referred to as a 

15 circular buffer and represents a natural or passive deletion method limited by hardware 
cost considerations. In this particular example, if 40 patients per day are analyzed, then 
25 days' worth of the three-dimensional data is retained. For a given case, after such 25- 
day period, the three-dimensional data is permanently lost. 

In addition to preserving storage space, one foreseeable advantage may lie in the 

20 result that the radiologist would only be held legally accountable, in a medical 
malpractice sense, for only that amount of image data that they were truly able to 
perceive during the viewing session, i.e., the thick-slice image data. It would arguably be 
very unfair to hold radiologists legally accountable for entire 4-GB datasets containing 
hundreds of separate planar images that they do not have the time to individually analyze. 

25 Thus, by archiving FFBU data according to the archival datasets of the preferred 

embodiments and not archiving the entire three-dimensional data volumes, subsequent 
medical malpractice claims involving unfair hindsight analyses of the entire ultrasound 
data volumes are avoided, while at the same time a medically sufficient subset of those 
three-dimensional data volumes is archived to assist in ftiture breast cancer screening for 

30 the patients. 
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FIG. 6 illustrates an example of an FFBU archival dataset 600 according to a 
preferred embodiment. Once again, it is to be appreciated that while the particular "flat- 
file" expression shown in FIG. 6 is indeed useful in a film-based or paper-based preferred 
embodiment, as well for generally communicating the features and advantages of the 
5 preferred embodiments in the present patent disclosure, the scope of the preferred 
embodiments extends to many other storage architectures. For example, the different 
component types such as text comments, 2-D images, annotations, and markers can all be 
digitally stored in different places, and even on different machines or networks, and 
associated with h3q)erlinks. 

10 Archival dataset 600 comprises an array of two-dimensional thick-slice images 

602, a first planar view 604, and a second planar view 606. The first planar view 604 
corresponds, in this example, to a sagittal plane (parallel to the x-y plane) passing through 
a location of a finding in the breast that was identified, assessed, and annotated by the 
viewer during a viewing session. The location of the finding is identified by a finding 

15 marker 608, which can be assigned to different shapes, colors, etc. for different kinds of 
findings and/or assessments. The second planar view 606 corresponds to a coronal plane 
(parallel to the x-z plane) passing through that location in the breast. Range markers 610 
and 612 that were automatically placed on the planar views according to the viewer- 
selected location on the viewer-selected thick-slice image are also archived as shown. An 

20 additional fi-ee annotation 632 that was entered by the viewer onto the display using the 
user interface of the viewing workstation 104 is also archived as shown. 

Archival dataset 600 further comprises a text section 614 comprising several 
components, some automatically generated by the viewing workstation 104 and others 
being manually entered (via the user interface, dictated, etc.). Text section 614 comprises 

25 header information 616 for identifying the patient, clinic, date, and the like, and further 
including an "FFBU Reason Code" portion that identifies why the patient received the 
FFBU procedure. These reason codes are preferably related to the FFBU qualifying 
criteria described supra. By way of example, the "A3" could stand for a geographic 
indicator (the patient lives in Marin County, for example) and the "C8" could stand for 

30 "very dense breasts." 



- 16- 




Text section 614 further comprises FFBU-session specific information 618 which 
can comprise, for example, the compression plane (PLANE=LCC), the associated gantry 
angle (ANGLE=0 deg), the compression plate distance and force used on the breast 
(COMPR=42mm 8 LBS), the thick-slice thickness corresponding to the slab thicknesses 
5 (TST=7mm), an ultrasonic power metric (P=79%, expressed relative to maximum FDA 
allowable power, and which can alternatively be expressed in absolute units such as 
mW/cm^), and a mechanical index metric (MI=0.9) indicating a relative potential for 
mechanical effects and based primarily on the phenomenon of cavitation and considering 
the biological effects associated with the collapse/implosion of microbubbles. 

10 Text section 614 further comprises a breast composition section 620 that can be 

automatically supplied (from previously obtained database information) or 
entered/modified by the FFBU scanning technician or by the viewer/radiologist. The 
viewer is identified in section 626. Text section 614 further comprises an x-ray finding 
section 622 and x-ray assessment section 628 corresponding to the determinations at step 

15 502, supra, and an FFBU finding section 624 and x-ray+FFBU assessment section 630 
corresponding to additional and/or modified determinations made at step 506, supra. 
Parts of the FFBU finding section 624 can be completed automatically, for example, the 
relevant thick-slice (TS=4), location (X=34MM Z=18MM), and volume 
(VOLUME=0.78CC) corresponding to the finding. 

20 The particular example of FIG. 6 portrays one simplified situation in which there 

is a cost-saving outcome that is made possible using adjunctive FFBU procedures. In 
particular, the independent x-ray assessment identified a density with a possibly indistinct 
border but that was at least partially obscured. The finding was troublesome enough for 
an ACR Category 4 assessment that might call for an invasive follow-up procedure, such 

25 as a fine-needle aspiration (FNA) biopsy, but it would be really useful if more 

information were quickly available. Advantageously, upon viewing the FFBU thick-slice 
images, it was readily determined that the lesion was probably a calcified fibroadenoma 
and could be reassessed to an ACR Category 3. In this case, the invasive and more 
expensive FNA procedure is avoided, and the patient is simply scheduled for a shorter 

30 term {e.g. , 3 month) follow-up imaging session to ensure that the size of the probable 
calcified fibroadenoma is not increasing with time. 
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According to a preferred embodiment, the thick-slice images 602 correspond to 
the body of thick-slice images normally presented to the radiologist on the display of the 
viewing workstation 104. Preferably, the slab-like subvolumes associated with the thick- 
slice images have an average thickness corresponding to a lesion size to be detected 
5 according to the FFBU imaging modality. At an upper end, a larger thickness of 20 mm, 
for example, may be used if it is desirable to overlook most of the small breast details and 
direct the user's attention to larger features on the order 10 mm in size. At a lower end, 
where very high ultrasound resolutions are both desired and available, a smaller thickness 
of 2 mm, for example, may be used if it is desirable to view small features on the order of 

10 1.3 mm in size. Although a wide range of different thicknesses are within the scope of 
the preferred embodiments and useful for different purposes, thicknesses in the range of 7 
mm - 12 mm are likely to be well-suited for most screening and archiving purposes. 

FIG. 7 illustrates an FFBU archival dataset 700 according to a preferred 
embodiment that is similar to that of FIG. 6 except that a full-size thick-slice image 702 

15 corresponding to the finding is archived. In one preferred embodiment, only those 
particular thick-slice images containing findings are archived and the remaining thick- 
slice images are actively or passively discarded. In another preferred embodiment, the 
archival dataset comprises multiple sheets/records containing the contents of both FIGS. 
6 and 7, with additional sheets/records corresponding to FIG. 7 being included for each 

20 separate lesion finding. In still another preferred embodiment, in which there are no 
lesion findings at all, the only image in the archival dataset is a single thick-slice image 
corresponding to a most benign-looking thick-slice image. 

FIG. 8 illustrates an FFBU archival dataset 800 according to a preferred 
embodiment comprising a first set 802 of thick-slice images corresponding to the RCC 

25 view, a second set 804 of thick-slice images corresponding to the LCC view, and a text 
section 806 similar to the text section 614. The archival dataset 800 is particularly 
applicable in situations where the FFBU qualifying criteria were met and the interest- 
heightening criteria were not met. In such case, FFBU scanning is only scheduled for a 
single compression plane such as the CC plane for each breast. If the x-ray mammogram 

30 and FFBU data both look good to the viewer (e.g.. Category 1), the archival dataset 800 
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is formed and archived. If one or more findings are present, additional sheets/records 
corresponding to FIGS. 6 or 7 are included in the archive dataset. 

FIG. 9 illustrates an FFBU archival dataset 900 according to a preferred 
embodiment comprising a first sheet/record 902 having CC and MLO thick-slice image 
5 datasets 906 and 908, respectively, for the left breast and a second sheet/record 904 
having CC and MLO thick-slice image datasets 912 and 914, respectively, for the right 
breast. Text sections 910 and 916 are also included similar to text sections 806/614 
supra. The archival dataset 900 is particularly applicable in situations where both the 
FFBU qualifying criteria and the interest-heightening criteria were met. In such case, 

10 more extensive FFBU scanning is scheduled having at least one additional compression 
plane, such as an MLO plane, for each breast. If the x-ray mammogram and FFBU data 
both look good to the viewer (e.g.. Category 1), the archival dataset 900 is formed and 
archived. If one or more findings are present, additional sheets/records corresponding to 
FIGS. 6 or 7 are included in the archive dataset. 

15 Notably, the preferred embodiments of FIGS. 8 and 9 are particularly 

advantageous in the event of a possible, but not yet actuated, change in government 
regulations and/or standard clinical procedures in which younger women, under the age 
of 40 for example, are to be regularly screened for breast abnormalities. In such a case, it 
would be desirable not to use x-ray mammography at all as part of the screening process 

20 because of the x-ray dosages involved which are cumulative over the patient's entire 
lifetime. Rather, only a non-x-ray based fiill-field modality, such as FFBU screening or 
MRI screening, is mandated. In such cases, the presentation of the thick-slice image data 
to radiologists and archiving of the radiologist-viewed thick-slice images according to the 
archive datasets of FIGS. 8 and 9 would be particularly useful. 

25 FIG. 10 illustrates a display of an adjunctive FFBU display 1000 according to a 

preferred embodiment that can be integrated into the viewing workstation 1 04, supra. A 
CRT monitor 1004 and an LCD monitor 1002 are packaged in a plastic frame case 1006 
which provides support and electrical safety protection. The FFBU display 1 000 can be 
mounted on a swayable arm so as to be movable close to displayed X-ray film and/or 

30 softcopy workstation displays. It can also be mounted on a film viewer table as shown in 
FIG. 1 , which is a preferred configuration because radiologists do not have to swing their 
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heads left to right to review X-Ray film and FFBU images. The LCD monitor 1002 
displays thick-slice images 1006, planar images 1008, and relevant text data 1012 as 
needed. One or both of the planar images 1008 and 1010 can be shown at full-scale. The 
CRT display 1004 also displays planar ultrasound views 1014 and 1016. The planar 
5 ultrasoimd views correspond to a cursor location 101 8 on the thick-slice images. 

In general, each display device has its own display property. Gamma correction 
for each monitor is required when image data from the same source output to different 
display device. Since current invention uses two or more monitors, separate gamma 
corrections are required. Commercially available graphic display cards provide two or 

10 more video outputs and Gamma corrections for each video output. This is an economic 
way to implement. Otherwise, two or more separate graphic display cards can be used, 
which provide separate Gamma corrections. 

According to a preferred embodiment, the FFBU display 1000 facilitates an image 
enlargement procedure. When the viewer enables a zoom fiinction, a virtual ROI 1020 

15 box is established according to a default setting (e.g., size, location). The viewer can use 
a computer trackball or mouse to resize or move the location of virtual ROI box 1020. 
The ultrasound image data is re-scan-converted and displayed based on the virtual ROI 
box location, dimensions, and/or other specifications. A zoomed version 1022 of the 
virtual ROI 1020 is displayed on CRT monitor 1004. 

20 Whereas many alterations and modifications of the present invention will no 

doubt become apparent to a person of ordinary skill in the art after having read the 
foregoing description, it is to be understood that the particular embodiments shown and 
described by way of illustration are in no way intended to be considered limiting. By 
way of example, while described above primarily in'terms of using several thick-slice 

25 images in the archival dataset to represent the clinically relevant breast volume for a 
particular view, in an alternative preferred embodiment there can be a single overall 
thick-slice image used to represent the ultrasound data volume. Preferably, this single 
overall thick-slice image is "intelligently" computed from the three-dimensional dataset 
in a manner that highlights lesions that may be contained in the breast using, for example, 

30 one or more of the computational methods described in U.S. Ser. No. 10/305,661 and 
U.S. Ser. No. 60/439,437, supra. Therefore, references to the details of the preferred 
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embodiments are not intended to limit their scope, which is Hmited only by the scope of 
the claims set forth below. 
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